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to furnish an instance of the sort of change which must be recog- 
nized, a change which, so far from thwarting the ends of knowing, 
is the very instrumentality through which these ends are achieved. 
This change is the stone which the builders of philosophic theory 
have hitherto rejected, but which has promise of usefulness as head 
of the corner. Questions relating to the character of things ante- 
dating experience and to the nature of the change which they 
undergo in becoming experienced derive most of their terrors from 
the assumption of the "external standpoint" which was criticized 
above. "This doctrine of the real efficiency of thought does not 
teach that thinking undoes or reverses or blots out any thing or 
event that has happened. It insists only that in becoming known 
or entering into knowledge a past act is altered in the sense that it 
takes on additional functions or consequences. ' ' 3 Similarly, the con- 
tents of a perceptual experience can hold membership in the physical 
order, because as experienced the objects of perception are con- 
strued with reference to their function of control. Every field of 
experience is thus dominated by a principle of organization, a 
"unique kind of centrality," in which both identity and change 
find a place. But it is not primarily to the cogency of this view so 
much as to its recognition of the character of the problem that I wish 
to direct attention. In view of the fact that the realist and the 
pragmatist hold so many conclusions in common, we may hope for 
a still more extensive agreement as the result of further reflection 
on the nature of consciousness and the "internal standpoint of ex- 
perience. ' ' 

B. H. Bode. 

University op Illinois. 



THE INFLUENCE OF FORM AND CATEGORY ON THE 
OUTCOME OF JUDGMENT 

CONTRARY to the statement of logicians experiment has shown 
that judgments of similarity and of difference are not merely 
the two sides of one and the same act of intellect, but involve each 
its own peculiar psychological processes and criteria, and that the 
category or the form in which the judgment is expressed, the attri- 
bute toward which it is directed, makes a considerable and measur- 
able difference in the outcome of that judgment. The present study 
reports an investigation, from a similar point of view, of certain 
other judgments commonly passed in daily life. 

Is a judgment of stupidity the exact reverse of a judgment of in- 

• Moore, "Pragmatism and its Critics," pages 103-4. 
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telligenee ? Is a judgment of preference the exact reverse of a judg- 
ment of dislike? In other words, do we use the same standard in 
judging characteristics designated by logical opposites, ranking all 
specimens according to the degrees by which they deviate positively 
or negatively from that standard? When we arrange specimens of 
handwriting in an order of merit with respect to resemblance to a 
given standard hand we use somewhat different criteria from those 
employed when the specimens are arranged according to their dif- 
ference from the standard. May it be also true that judgments of 
intelligence or of preference are based on different sets of criteria 
from those of judgments of stupidity or aversion? Do we like a per- 
son for certain qualities and dislike those who possess the exact anti- 
thesis of these qualities, or are our dislikes and preferences based on 
different sets of qualities? To discover which of these possibilities 
has the greater degree of probability is the main purpose of this 
study. 

The material consisted of 25 photographs of actresses. The 
photographs were similar in shape, size, finish, and mount, differing 
only with respect to the individual photographed and the pose as- 
sumed. In selecting the photographs care was taken to avoid those 
of well-known actresses, in order that past judgments might not 
influence the results of the experiment. These pictures were ranked 
in an order of merit, by 10 observers, with respect to preference, dis- 
like, intelligence, and stupidity. As the purpose was to discover the 
effect of the direction or category of judgment, special emphasis was 
laid on each category in the written instructions with which each of 
the observers was provided. These instructions were as follows: 

Preference 
Arrange the photographs in an order of merit, placing at the top the face 
you like the most, placing second the face you like next best, and so on, until 
the face you like the least is at the bottom of the series. 

Dislike 
Arrange the photographs in an order of demerit, placing at the top the 
face you dislike the most, placing second the one you dislike next intensely, and 
so on, until the one you dislike the least is at the bottom. 

Intelligence 
Arrange the photographs in an order of merit with respect to the intelligence 
of the face, putting at the top the most intelligent, next to it the next in intelli- 
gence, and so on, with the least intelligent face at the bottom of the series. 

Stupidity 
Arrange the photographs in an order with respect to the stupidity of the 
face, putting the most stupid at the top, next to it the next stupid, and so on, 
until the least stupid looking face is at the bottom of the series. 
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Five of the observers made the arrangements in the following 
order : 

1st week, ranked for preference and intelligence. 
2nd week, ranked for preference and intelligence. 
3rd week, ranked for dislike and stupidity. 
4th week, ranked for dislike and stupidity. 

The remaining five ranked for dislike and stupidity in the first two 
weeks, and for preference and intelligence in the last two weeks. 
This precaution was taken in order to minimize the influence of 
practise on the results of the group averages. In every case at least 
a week intervened between one judgment and the next. There was 
no clear evidence of decided memory effect except in the case of the 
extremes of the series. After the fourth arrangement the ob ervers 
were asked to write out a statement of the criteria used in judging 
each trait. The observers were all students of Barnard College, 
juniors or seniors taking their second or third year's work in psy- 
chology. 

In making the correlations to be discussed later, the formula 



r=l- 



6(ScZ 2 ) 
d{d 2 -l) 



was used. The correlations were worked out between each observ- 
er's two trials (I. and II.), and between each observer's average 
judgment (a) with the group judgment {A), for each of the four 
traits. These results are given in Table I. 

TABLE I 
These Coefficients of Correlation are all Positive 



Observer 



Ell. Car. Ste. Hal. DeN. Str. Bro. Bar. Val. Cas. At. M.V. 



Correlations of I. and II. 

Preference 

Dislike 



Intelligence . 
Stupidity. . , 



Correlations of o with A : 

Preference 

Dislike 



Intelligence 32 29 32 48 

Stupidity 54 57 55 52 



58 
48 



80.8 
79.0 

82.6 
79.9 



50.1 
49.0 



10.6 
11.0 



6.0 
6.5 



7.7 
9.6 



43 41 32 59 26 30 37.2 8.4 
62 46 62 36 42 36 50.2 8.2 



Table II. gives the correlations between each order and the recip- 
rocal of its supposed opposite (by the reciprocal is meant the in- 
verted order, so that what was originally the bottom of the series 
becomes the top). If categories logically opposite are also psycho- 
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logically the two sides of the same act of intellect, then the correla- 
tion between preference and the reciprocal of dislike should be equal 
to the average of the personal consistency coefficients for preference 
and for stupidity. That is to say, the inverted order for dislike 
should coincide with the direct order for preference, and should cor- 
relate as closely with this direct order as would two trials for prefer- 
ence with each other. The same relation should be expected to hold 
between intelligence and stupidity. On the other hand, if the proc- 
esses differ from each other psychologically, it would seem that the 
correlation between preference and the reciprocal of dislike (both 
standards or categories being involved) should be less than the corre- 
lations of two trials for preference or of two trials for dislike. The 
same, again, should hold for intelligence and stupidity. 



TABLE II 



Observer 


Ell. 


Car. 


Ste. 


Hal. 


DeN. 


Str. 


Bro. 


Bar. 


Val. 


Cas. 


Aver- 
age 


Correlations of: 

1. Pref. and the recip. of disl. 

2. Av. of pref. I. and II., and 


60 

56 

85 

74 


89 

81 
79 

84.5 


93 

86.5 
93 

89.5 


94 

94.5 
90 

89.5 


90 

77.5 
94 

80.5 


57 

73.5 
74 

73 


86 

86 
73 

78.5 


78 

81 

87 

71 


89 

85 
86 

86.5 


83 

78 
96 

84.5 


81.9 
79.9 


3. Int. and the recip. of stup. 

4. Av. of int. I. and II., and 


85.7 
81.2 



At first glance, as the results are presented in this table, the 
situation does not seem to be similar to that found in the study of 
judgments of similarity and difference. In 6 of the 10 cases the 
correlation between preference and the reciprocal of dislike is greater 
than the average correlations of similar arrangements, and in two 
of the remaining cases there is no difference between the two. The 
average shows a small per cent, in favor of the former. 

In the case of intelligence and stupidity, 7 of the 10 observers 
have higher correlation between the judgment of intelligence and 
the reciprocal of stupidity than the average correlation of similar 
arrangements, and the average shows superiority in this direction 
of 4.5 per cent. 

It is apparent then that if these character judgments really have 
the same psychological differences as those found between judgments 
of similarity and difference, some factor is present in this experiment 
which obscures the difference. 

Table III. indicates that this factor is practise, adaptation, or 
familiarity with the material, and that before these factors operate 
genuine psychological differences are disclosed. In this table the 
trials are not averaged as in Table II., but the first order for prefer- 
ence is correlated with the reciprocal of the first order for dislike, 



PSYCHOLOGY AND SCIENTIFIC METHODS 



517 



and the second order for preference with the reciprocal of the second 
order for dislike. In a similar way are handled the arrangements 
according to intelligence and stupidity. Each of these indirect cor- 
relations is then compared with the average of the direct correla- 
tions, — that is, with the average of preference with preference, and 
dislike with dislike. This also is done in the case of intelligence and 
stupidity. 

In both cases the results are clear. The correlation of the first 
of the positive quality with the reciprocal of the first of the nega- 
tive quality is less than the average correlation of positive and nega- 
tive qualities with themselves. In the case of preference and dislike 
there is no exception to this rule, and the average difference amounts 
to over 13 per cent. In the case of intelligence and stupidity 3 of 
the observers are exceptions, but the other 7 show the difference 
clearly ; a difference which averages, for the 10 observers, over 5 per 
cent. Averaging the two types of judgment, in the lower part of 
the table, there is no exception to the rule, and the average superior- 
ity amounts to over 9 per cent. 

TABLE III 



Obaerver 



Ell. 


Cur. 


Ste. 


Hal. 


DeN. 


Str. 


Bro. 


Bar. 


Val. 


Cas. 


56 


81 


87 


95 


78 


74 


86 


81 


85 


78 


22 


81 


83 


91 


66 


43 


77 


56 


80 


67 


59 


80 


90 


95 


92 


55 


79 


86 


82 


90 


74 


85 


90 


90 


81 


73 


79 


71 


87 


85 


72 


78 


88 


88 


87 


53 


52 


73 


77 


92 


83 


78 


88 


90 


91 


69 


86 


84 


83 


87 


65 


82 


88 


92 


79 


73 


82 


76 


86 


81 


47 


80 


86 


90 


77 


48 


65 


65 


79 


80 


71 


79 


89 


93 


92 


62 


83 


85 


83 


89 



Aver- 
age 



Av. pref. (I. and II.) and disl. 

(I. and II.) 

Pref. I. and recip. of disl. I. 
Pref. II. and recip. of disl. II. 

Av. int. (I. and II.) and stup. 

(I. and II.) 

Int. I. and recip. of stup. I.. 
Int. II. and recip. of disl. II. 

Av. pos. and neg. (I. and II.) 
Pos. I. and recip. of neg. I. . 
Pos. II. and recip. of neg. II. 



79.9 
66.6 
80.8 



81.2 
76.0 
83.9 

80.5 
71.3 
82.3 



The influence of practise, adaptation, and familiarity with the 
material is shown by comparing the third row of coefficients in each 
group of Table III. with the second row of the same section. In 
these third rows the correlation of the second direct arrangements 
with the second of the reciprocal arrangements is seen to move up, 
in each case, and very clearly in the average, to the correlation of 
two direct arrangements for a given trait. In fact the coefficients 
are usually a little higher. Very evidently, then, in the beginning 
of the experiment, before the two categories have been brought to- 
gether in the consciousness of the observer in any explicit way, the 
judgment of a negative quality is not the exact antithesis of that of a 
positive quality. A judgment of dislike, that is to say, is not merely 
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the reverse aspect of a judgment of preference, but a new kind of 
judgment, with perhaps different criteria, and certainly with a dif- 
ferent outcome. The same must be said of judgments of intelli- 
gence and stupidity. The form of expression, the direction or cate- 
gory of the judgment, has a measurable influence on the outcome of 
that judgment. But as the experiment proceeds and the two cate- 
gories are both explicitly brought to the consciousness of the ob- 
server, and after practise, adaptation and familiarity with the ma- 
terial have played their part, the difference between the two cate- 
gories tends to fall away, and the form or direction of the judgment 
no longer influences its outcome. 

This tendency is the same as that remarked in the study of the 
judgments of similarity and difference in the case of handwriting, 
where it is found that with practise and repetition the two judg- 
ments come to resemble each other, and the inverted order for dif- 
ference to agree more closely with the direct order for similarity. 

This tendency is further shown by the figures in Table IV., in 
which the correlation of the first two trials of a given observer is 
compared with the correlation of his last two trials, regardless of the 
category of judgment concerned. "With a single exception the latter 
coefficient is always higher than the former, the average of the ten 
observers showing a superiority of 7 per cent. 

TABLE IV 



Observer 


Ell. 


Car. 


Ste. 


Hal. 


DeN. 


Str. 


Bro. 


Bar. 


Val. 


Cas. 


Average 




63 
67 


79 

87 


89 
88 


92 
93 


73 

85 


73 

74 


79 

87 


68 
85 


84 
88 


73 
90 


77.0 




84.2 







TABLE V 
Personal Consistency Compared with General Judicial Capacity 



Observer 


Ell. 


Car. 


Ste. 


Hal. 


DeN. 


Str. 


Bro. 


Bar. 


Val. 


Cas. 


Average 


Average correlations of I. 
with II 


65 
47 


83 
51 


88 
52 


92 
39 


79 

51 


73 
42 


83 
49 


76 
47 


86 
46 


81 
43 


80 6 


Average correlations of a 


46 6 











TABLE VI 



Ratio of Best to Poorest 


Preference 


Intelligence 


Dislike 


Stupidity 


Average 


Correlation of a with A 


96:55 
58:23 


92:71 
59:26 


98:57 
64:27 


89:65 
62:36 


1.51:1.00 
2.15:1.00 




1.83:1.00 



TABLE 


VII 

Averages of 






10.6 


Subjective judgments . 


78.9 


10.8 


6.0 


Objective judgments . . 


81.3 


6.2 


11.0 


Positive judgments . . . 


81.7 


8.3 


6.5 


Negative judgments . . 


79.4 


8.8 


7.7 


Subjective judgments . 


49.5 


8.6 


8.4 


Objective judgments . . 


43.7 


8.3 


9.6 


Positive judgments . . . 


43.7 


7.9 


8.2 


Negative judgments . . 


49.6 


8.9 
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Correlations of 
I. and I.: 

Preference 80.8 

Intelligence 82.6 

Dislike 79.0 

Stupidity 79.9 

a with A: 

Preference 50.1 

Intelligence 37.2 

Dislike 49.0 

Stupidity 50.2 

The introspection was of little value, consisting for the most part 
of mere generalization. But where specific criteria were given the 
presence of the two standards was apparent. For example, Ob- 
server Hal. — "I like eyes looking straight at me. I don't like head 
or eyes to have unnatural pose, because it looks affected. I can't 
abide frowsy hair. I like smiling eyes and mouth and a high fore- 
head." Here the first two criteria do seem to be opposed — eyes 
looking straight at one are not usually eyes in an unnatural pose. 
But other criteria show the two standards. The observer " can't 
abide" frowsy hair, but she does not specifically admire smooth 
coiffures. She likes high foreheads, but expresses no positive dis- 
like for low ones. 

Some incidental points brought out in the results are worth 
noting. In Table V. the personal consistency of each observer is 
compared with her correlation with the group average. The coeffi- 
cient (.06) shows that there is absolutely no correlation between the 
two. This seems to indicate an absence of general judicial capacity. 

In Table VI. the ratio of best to poorest is given, and the familiar 
ratio of about 2:1 found. 

Table VII. seems to show that the more subjective judgments of 
preference and dislike are more variable and uncertain than the 
more objective ones of intelligence and stupidity. The coefficients 
are slightly lower on the average and the mean variations are larger. 
This is true whether personal consistency or judicial capacity is con- 
cerned. The coefficients for the negative judgments of dislike and 
stupidity also show a higher variability than do those of the positive 
judgments of preference and intelligence. 

Summary 

1. Judgments which are grammatically opposite (as preference 
and dislike, intelligence and stupidity) involve, in the beginning of 
the experiment, psychological processes and criteria which are not 
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identical. The form, direction, or category of the judgment exerts 
a measurable difference on its outcome. 

2. As the experiment proceeds the processes and criteria move 
to a common plane and the two types of judgment resemble each 
other more closely. This movement to a common plane is apparently 
the result of repetition, adaptation, and familiarity with the ma- 
terial, and of the fact that the two categories, hitherto implicitly 
distinct from each other, are now brought explicitly together in the 
consciousness of the observer. 

3. The result of practise and familiarity with the material is to 
increase the personal consistency of the observer's judgments. 

4. Introspection suggests different criteria for judgments which 
are grammatically or logically only two sides of the same intellec- 
tual act. 

5. There is seen to be no correlation between personal consist- 
ency and agreement with the group average. 

6. The ratio of best to poorest, in both these respects, is the fa- 
miliar one of about 2:1. 

7. Subjective judgments (of preference and dislike) are more 
variable and uncertain than the more objective judgments (of in- 
telligence and stupidity). 

8. The coefficients of "negative" judgments (dislike and stupid- 
ity) are more variable than those of the "positive" judgments 
(preference and intelligence) . 

Margaret Hart Strong. 
h. l. hollingworth. 
Columbia University. 



DISCUSSION 
SOMETHING MORE ABOUT INVERSION: A REJOINDER 

I AM much obliged to Dr. Karl Schmidt for his critical notice of 
my article on "Inversion." 1 He has added to the evidence that 
inversion is practically worthless. For note carefully what his equa- 
tions prove. Prom " All A is B" he proves that if A exists, and if 
B exists, then the A which is also B exists. To put it in concrete 
terms, from "All men are mortal" he proves that if not-men exist 
and if immortals exist, then not-men who are also immortals exist. 
The inverse is a simple categorical proposition, "Some not-men are 
immortal." Dr. Schmidt succeeds only in proving a very complex, 
doubly-conditioned hypothetical conclusion. This difference be- 
tween the real inverse and what he actually proves is probably one 
1 This Journal, Vol. IX., page 232. My article is in Vol. IX., page 65. 



